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CN ! Abstract 



The program of studying general nonlinear Markov processes was put forward 
in [6]. This program was developed by the author in monograph [10], where, in 
particular, nonlinear Levy processes were introduced. The present paper is an 
invitation to the rapidly developing topic of this monograph. We provide a quick 
(and at the same time more abstract) introduction to the basic analytical aspects 
of the theory developed in Part II of [10J. 

1 Introduction 

ON . 

Nonlinear Levy processes were introduced by the author in [ID] . We provide a quick 
introduction to the basic analytical aspects of the theory developed in Part II of [10] giving 
q \ more concise and more general formulations of some basic facts on well-posedness and 
^ | sensitivity of nonlinear processes. For general background in Levy and Markov processes 
. . ■ we refer to books pQ, [H], [T2] . 

For sensitivity of the nonlinear jump-type processes, e.g. Boltzmannn or Smoluchovski, 
^ . we refer to papers [5] and [2]. 

Loosely speaking, a nonlinear Markov evolution is just a dynamical system generated 
by a measure-valued ordinary differential equation (ODE) with the specific feature of 
preserving positivity. This feature distinguishes it from a general Banach space valued 
ODE and yields a natural link with probability theory, both in interpreting results and in 
the tools of analysis. Technical complications for the sensitivity analysis, again compared 
with the standard theory of vector-valued ODE, lie in the specific unboundedness of 
generators that causes the derivatives of the solutions to nonlinear equations (with respect 
to parameters or initial conditions) to live in other spaces, than the evolution itself. From 
the probabilistic point of view, the first derivative with respect to initial data (specified 
by the linearized evolution around a path of nonlinear dynamics) describes the interacting 
particle approximation to this nonlinear dynamics (which, in turn, serves as the dynamic 
law of large numbers to this approximating Markov system of interacting particles), and 
the second derivative describes the limit of fluctuations of the evolution of particle systems 
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around its law of large numbers (probabilistically the dynamic central limit theorem) . In 
this paper we concentrate only on the analytic aspects of the theory referring to [10] for 
probabilistic interpretation. 

Recall first the definition of a propagator. For a set S, a family of mappings U t,r , from 
S to itself, parametrized by the pairs of real numbers r < t (resp. t < r) from a given finite 
or infinite interval is called a forward propagator (resp. a backward propagator), if U t,t is 
the identity operator in S for all t and the following chain rule, or propagator equation, 
holds for r < s < t (resp. for t < s < r): JJ t,s U s,r = U t,r . If the mappings U t,r forming 
a backward propagator depend only on the differences r — t, then the family T* = U 0,t 
forms a semigroup. That is why, propagators are sometimes referred to as two-parameter 
semigroups. By a propagator we mean a forward or a backward propagator (which should 
be clear from the context). 

Let M.(X) be a dense subset of the space Ai(X) of finite (positive Borel) measures 
on a polish (complete separable metric) space X (considered in its weak topology). By a 
nonlinear sub-Markov (resp. Markov) propagator in Ai(X) we shall mean any propagator 
V t)T of possibly nonlinear transformations of M.(X) that do not increase (resp. preserve) 
the norm. If V t,r depends only on the difference t — r and hence specifies a semigroup, 
this semigroup is called nonlinear or generalized sub-Markov or Markov respectively. 

The usual, linear, Markov propagators or semigroups correspond to the case when 
all the transformations are linear contractions in the whole space Ai(X). In probability 
theory these propagators describe the evolution of averages of Markov processes, i.e. pro- 
cesses whose evolution after any given time t depends on the past X< t only via the present 
position X t . Loosely speaking, to any nonlinear Markov propagator there corresponds a 
process whose behavior after any time t depends on the past X< t via the position X t of 
the process and its distribution at t. 

More precisely, consider the nonlinear kinetic equation 

^(9,t*t) = (A[fit]g,fit) (1) 

with a certain family of operators A[p] in C(X) depending on /i as a parameter and 
such that each A[fj] specifies a uniquely defined Markov process (say, via solution to the 
corresponding martingale problem, or by generating a Feller semigroup). 

Suppose that the Cauchy problem for equation (pQ) is well posed and specifies the 
weakly continuous Markov semigroup T t in Ai(X). Suppose also that for any weakly 
continuous curve m G V(X) (the set of probability measures on X) the solutions to the 
Cauchy problem of the equation 

j t (g,v t ) = (A[fi t ]g,v t ) (2) 

define a weakly continuous propagator V*' r [/x.], r < t, of linear transformations in Ai(X) 
and hence a Markov process in X, with transition probabilities p^ t \x,dy). Then to any 
/Lt G V{X) there corresponds a (usual linear, but time non-homogeneous) Markov process 
X" in X [y stands for an initial distribution) such that its distributions v t solve equation 
(J2J) with the initial condition v. In particular, the distributions of X£ (with the initial 
condition /i) are /it = T t (fi) for all times t and the transition probabilities p^ t \x,dy) 
specified by equation (T5]) satisfy the condition 

/ f(y)p [ r " t ] (x,dy)^(dx) = (f,V t ^ r ) = (f, f i t ). (3) 
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We shall call the family of processes Xf a nonlinear Markov process. When each A[/j] 
generates a Feller semigroup and T t acts on the whole Ai(X) (and not only on its dense 
subspace), the corresponding process can be also called nonlinear Feller. Allowing for the 
evolution on subsets M(X) is however crucial, as it often occurs in applications, say for 
the Smoluchovski or Boltzmann equation with unbounded rates. 

Thus a nonlinear Markov process is a semigroup of the transformations of distribu- 
tions such that to each trajectory is attached a "tangent" Markov process with the same 
marginal distributions. The structure of these tangent processes is not intrinsic to the 
semigroup, but can be specified by choosing a stochastic representation for the generator, 
that is of the r.h.s. of (121). 

In this paper we shall prove a general well-posedness result for nonlinear Markov 
semigroups that will cover, as particular cases, 

(i) nonlinear Levy processes specified by the families 

A,f(x) = ~(G^)V, V)/(x) + (%), V/)(x) 

+ f[f(x + y)-f(x)-(y,Vf(x))l Bl (y)}p(fx,dy), (4) 

where, for each probability measure fi on R d , u(fi, .) is a Levy measure (i.e. a Borel 
measure on R d without a mass point at the origin and such that the function min(l, \y\ 2 ) 
is integrable with respect to it), G(fi) is a symmetric non-negative d x <i-matrix, 6(/i) a 
vector in R d and Bi is the unit ball in H d with l Bl being the corresponding indicator 
function; 

(ii) processes of order at most one specified by the families 

A,f(x) = (b(x, /i), V/(x)) + / (f(x +y)- f(x))v{x, /i, dy), (5) 

where the Levy measure v is supposed to have a finite first moment; 

(iii) mixtures of possibly degenerate diffusions and stable-like processes and processes 
generated by the operators of order at most one, explicitly defined below in Proposition 

ED 

It is worth noting that equations of type fl2]) that appear naturally as dynamic Law of 
Large Numbers for interacting particles, can be deduced, on the other hand, from the mere 
assumption of positivity preservation, see [10] and [H] . In case of diffusion (partial second 
order) operators A[fj], the corresponding evolution ([I]) was first analyzed by McKean and 
is often called the McKean or McKean- Vlasov diffusion. Its particular case that arises as 
the limit of grazing collisions in the Boltzmann collision model is sometimes referred to 
as the Landau- Fokker- Planck equation, see [I] for some recent results. The case of A\p] 
being a Hamiltonian vector field is often called a Vlasov-type equation, as it contains the 
celebrated Vlasov equation from plasma physics. The case of A\p] being pure integral 
operators comprises a large variety of models from statistical mechanics (say, Boltzmann 
and Smoluchovskiu equations) to evolutionary games (replicator dynamics), see [10J for a 
comprehensive review and papers [3], [15], [16] for the introduction to nonlinear Markov 
evolutions from the physical point of view. 

The following basic notations will be used: 

Cqc^R^) C C(R d ) consists of / such that lim^oo f(x) = 0, 
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C k (R d ) (resp. C^(R )) is the Banach space of k times continuously differentiable 
functions with bounded derivatives on H d (resp. its closed subspace of functions / with 
G Coo(R d ), / < k) with 

k 

ll/llc fc (R d ) = H/ (/) Hc(R d ) ) 
1=0 

V(R d ) the set of probability measures on R d . 

|| A || denotes the norm of an operator A in the Banach space C(D, B) of bounded 
linear operators between Banach spaces D and B, and ||£||b denotes the norm of £ as an 
element of the Banach space B. 



2 Dual propagators 

A backward propagator {U t ' r } of uniformly (for t, r from a compact set) bounded linear 
operators on a Banach space B is called strongly continuous if the family U t)T depends 
strongly continuously on t and r. 

For a strongly continuous backward propagator {[/* ,r } of bounded linear operators on 
a Banach space B with a common invariant domain D C B, which is itself a Banach 
space with the norm || \\d > \\ \\b, let {A t }, t > 0, be a family of bounded linear operators 
D — )■ 5 depending strongly measurably on t (i.e. the function t H- At/ G -B is measurable 
for each / G D). Let us say that the family {A t } generates {U t,r } on the invariant domain 
D if the equations 

SL.U t >'f = U**A 8 f, ^-U s > r f = -A s U s > r f, t<s<r, (6) 
as as 

hold a.s. in s for any f £ D, that is there exists a negligible subset 5 of R such that 
for all t < r and all / G £> equations (jSJ) hold for all s outside 5, where the derivatives 
exist in the Banach topology of B. In particular, if the operators A t depend strongly 
continuously on t (as bounded operators D — >■ B), this implies that equations (JBJ) hold 
for all s and / G D, where for s = t (resp. s — r) it is assumed to be only a right (resp. 
left) derivative. 

For a Banach space B or a linear operator A one usually denotes by or A* its 
Banach dual (space or operator respectively). Alternatively the notations B' and A' are 
in use. 

Theorem 2.1. (Basic duality^) 

Let {U t,r } be a strongly continuous backward propagator of bounded linear operators 
in a Banach space B with a common invariant domain D, which is itself a Banach space 
with the norm > \\ \\b, and let the family {A t } of bounded linear operators D — > B 
generate {U t,r } on D. Then 

(i) the family of dual operators V S)t = (£/*' s )* forms a weakly-* continuous in s,t 
propagator of bounded linear operators in B* (contractions if all U t,r are contractions) 
such that 

^V s '*£= -V^AX, -^*£ = A*V'^, t<s, (7) 
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hold weakly-* in D*, i.e., say, the second equation means 

^(/,V''*0 = (>U,V'«O, t<s, feD; (8) 

(ii) V s,t ^ is the unique solution to the Cauchy problem of equation (jBJ) in B* , i.e. if 
£t = £ f or a given £ G B* and £ s , s G [i, r] ; a weakly-* continuous family in B* satisfying 

^L(f,Z s ) = (A s f,Q, t<s<r, feD, (9) 

then £ s = V s '*£ for t < s < r. 

(Hi) U s,r f is the unique solution to the inverse Cauchy problem of the second equation 
in ©. 

Proof. Statement (i) is a direct consequence of duality. 

(ii) Let g(s) = (U s ' r f,^ s ) for a given feD. Writing 

(U s+S > r f, Us) ~ (U s ' r f, Q 

= (u s+s > r f - u s ' r f, £ s ) + (u s > r f, Us - £.) 

+ ( U *+6,T f _ U .,r fi £ a+s _£ a) 

and using flH]), flE]) and the invariance of D, allows one to conclude that 

±g(a) = -(A s U s ' r f,is) + (U s > r f,A%) = 0, 

because a.s. in s 

( U s+5,r f _ U s,r f X 

I 7 , Us - Ss I U, 

as 5 — >■ (since the family <5 _1 (£/ ,S+<5 ' T 7' — U s,r f) is relatively compact, being convergent, 
and £ s is weakly continuous). Hence g(r) = (/,&•) = gif) = (£^*' r f,Ct), showing that £ r is 
uniquely defined. 

(iii) is proved similar to (ii). □ 

Remark 1. In addition to the statement of Theorem \2.1\ let us note (as one sees directly 
from duality), that (i) V s,t ^ depend weakly-* continuous on s,t uniformly for bounded £ 
and (ii) V s,t is a weakly-* continuous operator, that is £ n — > £ weakly-* implies V s,t £, n — > 
V s,t t; weakly-*. 

Remark 2. Working with discontinuous A t is crucial for the development of the related 
theory of SDE with nonlinear noise, see /#/ and [9j. In this paper we shall use only 
continuous families of generators {At}. 

We deduce now some corollaries of Theorem 12.11 on the extension of the operators 
V s,t to D*, and on their stability with respect to a perturbation of the family A t . 

Theorem 2.2. Under the assumptions of Theorem \2. 1\ suppose additionally that 

(i) {U t,s } is a strongly continuous backward propagator of uniformly bounded operators 
in D; 



5 



(ii) there exists another subspace D C D, dense in D, which is itself a Banach space 
with the norm || ||^ > || ||o such that the mapping t A t is a continuous mapping 
t^C(D,D); 

(Hi) B* is dense in D* (which holds automatically in case of reflexive D). 

Then the operators V s,t : B* — >■ B* extend to the operators V s,t : D* — > D* forming 
a weakly-* continuous propagator in D* that solves equation ([5]) weakly-* in D* , that is, 
for any £ G D* , equation ([8]) holds for all f G D. 

Proof. The fact that V s,t extend to linear operators in D* follows without any additional 
assumption from the invariance of D under U t,s . Assumption (i) implies that this ex- 
tension is bounded and weakly-* continuous in D*. In order to prove that ([8]) holds for 
/ G D and £ G D*, observe that 

(/, v r ' l = (f, + J T (A s f, V^) ds (10) 

for £ G B*, f G D. Now, for a £ G D* and / G D, let us pick up a sequence £ n G B* 
such that £ n — > £ in the norm topology of D* as n — > oo (which is possible by assumption 
(hi)). As A s f G -D (by assumption(ii)), we can pass to the limit in fflOl) with £ n instead 
of £ (using dominated convergence) yielding fflQ|) for £ G and f £ D. Finally, as 
(A s f, V s,t l;) is a continuous function of s (by assumption (ii) and the weak-* continuity 
of V s ' 1 in D*), equation PD implies (JED for £ G and / G -D. □ 

Theorem 2.3. Under the assumptions of Theorem \2.2\ assume additionally that the back- 
ward propagator {U t,s } in D is generated by {A t } on the invariant domain D (in particular 
D is invariant and equations ([6]) hold in the norm topology of D for any f G D). Then 
V s,t £ represents the unique weakly-* continuous in D* solution of equation §8§ in D* . 
Moreover, for the propagator {U t,s } in D to be generated by {A t } on D it is sufficient to 
assume that {U tyS } is a strongly continuous family of bounded operators in D. 

Proof. The first statement is a direct consequence of Theorem 12.11 applied to the pair of 
spaces D, D. The last statement is proved as in the previous theorem. Namely, we first 
rewrite equation in the integral form, i.e. as 

C^7 = f + £ A s US ' r f ds ' Ut ' r f = f + [ ut ' SA sf ds. (11) 

These equations would imply ([6]) with the derivative defined in the norm topology of 
D, for / G D, if we can prove that the functions A s ll s,r f and U t,s A s f are continuous 
functions s D. To see that this is true, say for the first function, we can write 

A s+s U s+5 > r f - A s U s > r f = A sU (U s+5 > r f - U s > r f) + (A s+S - A s )U s > r f. 

The first term tends to zero in the norm topology of D, as 5 — > 0, by the strong continuity 
of U s ' r in D, and the second term tends to zero by the continuity of the family A s 
(assumption (ii) of Theorem 12.21) . □ 

We conclude this section with a simple result on the convergence of propagators. 
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Theorem 2.4. Suppose we are given a sequence of backward propagators {U^ r }, n = 
1, 2, generated by the families {A™} and a backward propagator {U t,r } generated by the 
family {A t }. Let all these propagators satisfy the same conditions as £7 <,r and A t from 
Theorem \2.1\ with the same D, B. Suppose also that all U t,r are uniformly bounded as 
operators in D. 

Assume finally that, for any t and any f G D, A™f converge to A t f , as n — > oo, in 
the norm topology of B. Then U^ r converges to U t,r strongly in B. Moreover, 

HOC* - v r ^\\ D * < c\\a: - A s \\ d ^ b U\\b*. (12) 

Proof. By the density argument (taking into account that U% r g are uniformly bounded in 
B), in order to prove the strong convergence of U^f to U t,T , it is sufficient to prove that 
U^fg converges to U t,r g for any g £ D. But if g G D, 

(ce - u'ng = vpwg \: =t = ^ u^ s (a: - wg d S , (13) 

which converges to zero in the norm topology of B by the dominated convergence. Esti- 
mate (|T2|) also follows from (|T3|) . □ 



3 Perturbation theory for weak propagators 

The main point of the perturbation theory is to build a propagator generated by the 
family of operators {A t + Ft}, when a propagator U t,r generated by {A t } is given and 
{F t } are bounded. However, if {F t } are only bounded, then instead of the solutions to 
the equation 

±f = AJ + F s f, t<s<r, (14) 

with a given terminal f r , as desired, one can only construct the solutions to the so called 
mild form of this equation: 

ft = U t ' r f + f U^Fsfsds, (15) 

which is only formally equivalent to (jT4"|) (i.e. when a solution to the mild equation is 
regular enough which may not be the case). 

Let us recall the simplest perturbation theory result for propagators, which clarifies 
this issue (a proof can be found e.g. in [TT], Theorem 1.9.3, and simpler, but similar fact 
for semigroups is discussed in almost any text book on functional analysis). 

Theorem 3.1. (i) Let U t,r be a strongly continuous backward propagator of bounded linear 
operators in a Banach space B, and {F t } be a family of bounded operators in B depending 
strongly continuous on t. Set 

$ t,r = Tjt,r + / Tjt,s FsU s,r ds + U l ' Sl F Sl U Sl ' S2 ■ ■ ■ F Sm U Sm ' r d Sl ■ ■ ■ ds m . 

Jt m= i^t<si<---<Sm<r 

(16) 
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It is claimed that this series converges in B and the family {$*' r } also forms a strongly 
continuous propagator of bounded operators in B such that ft = <3>*' s / is the unique solution 



(ii) Suppose additionally that a family of linear operators {A t } generates {U t,r } on the 
common invariant domain D, which is dense in B and is itself a Banach space under a 
norm \\-\\d > II -lis- Suppose that U t,r and {F t } are also uniformly bounded operators in 
D. Then D is invariant under {$*' r } and the family {A t + F t } generates {$' ,r } on D. 
Moreover, series (fTBT) also converges in the operator norms of D and operators $*' r / are 
bounded as operators in the Banach space D. 

We presented this theorem, because for the sensitivity analysis of nonlinear equations 
we shall need non-homogeneous extensions of equations ([9]) of the form 



where F s is a family of operators bounded in D, but, what is crucial and necessitates 
technical complications, not bounded in B. 

Under the assumption of Theorem 12.31 and assuming {F t } is a bounded strongly con- 
tinuous family of operators in D, it follows directly from Theorem 13.11 (ii) applied to the 
pair of Banach spaces (D, D) that the perturbation theory propagator ( fl6i) solves equa- 
tion (|T%|) in D and is generated on D by the family {A t + F t }. Hence, by Theorem 12.11 
the dual propagator {ty r ' t = ($' ,r )'} is weakly-* continuous in D* and yields a unique 
solution to ( TT7T) in D* (i.e. so that, for £ s = \I/ S '*£f, equation (fT7|) holds for all / G D). 

The next result proves the same fact, except for uniqueness, under weaker assumptions 
of Theorem 12.21 

Theorem 3.2. Under the assumptions of Theorem \2.S\ assume {F t } is a bounded strongly 
continuous family of operators in D. Let {$*' r } be given by ffl6|) . which by Theorem \3.1\ 
(i) (applied to the pair of Banach spaces (D,D)) is a strongly continuous propagator in 
D, and let {\J/ r >* = ($*' r ) / } ; which is clearly a weakly-k continuous backward propagator in 
D* . Then the curve £ s = solves equation (|17|) in D* with a given terminal condition 

£ t; that is (|17[) holds for all f e D. 

Proof. From duality and ([IE]) it follows that 



where F' s are of course dual operators to F s , and where the integral is understood in 
weak-* sense and the series converges in the norm-topology of D* (we need to take into 
account Remark [2] to see that the weak integral is well defined) . To prove (1171) for / G D 
we should now differentiate term by term the corresponding series (/, W^C,) with respect 
to r using Theorem 12.21 This term-by-term differentiation is then justified by the fact 
that the series of derivatives 



to equation (TL5I) . 




(17) 





(A r f, V r >%) + (F r f, V r >%) + / (A r f, V r > s F' s V s *) ds +■■■ 




converges uniformly in r. 



□ 
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4 T-products 



Here we shall recall the notion of T-products showing how they can be used to construct 
propagators generated by families of operators each of which generates a sufficiently reg- 
ular semigroup. 

We shall work with three Banach spaces Bq,Bi,B 2 with the norms denoted by || ||;, 
i = 0, 1,2, such that B C B\ C B 2 , B is dense in B\, B\ is dense in B 2 and || || > 

Let L t : Bi i— > B 2 , t > 0, be a family of uniformly (in t) bounded operators such 
that the closure in B 2 of each L t is the generator of a strongly continuous semigroup of 
bounded operators in B 2 . For a partition A = {0 = to < h < ■■■ < t/v = t} of an interval 
[0, t) let us define a family of operators U A (r, s), < s < r < t, by the rules 

Ua(t,s) = exp{(r - s)L tj }, tj < s < r < t j+1 , 

U a (t, r) = U a {t, s)U a {s, r), 0<r<s<r<t. 
Let Atj = tj + i — tj and S(A) = max^ Atj. If the limit 

U(s,r)f= lim U A (s,r)f (19) 

5(A)^0 

exists for some / and all < r < s < t (in the norm of B 2 ), it is called the T-product 
(or chronological exponent) of L t and is denoted by T exp{j^ L T dr}f . Intuitively, one 
expects the T-product to give a solution to the Cauchy problem 

4/> = L t 0, 0o = /, (20) 
at 

in B 2 with the initial conditions / from B\. 

Theorem 4.1. Let a family L t f , t > 0, of linear operators in B 2 be given such that 

(i) each L t generates a strongly continuous semigroup e sLt , s > 0, in B 2 with invariant 
core B\, 

(ii) L t are uniformly bounded operators Bq — > B\ and B\ — Y B 2 , 

(Hi) B is also invariant under all e sLt and these operators are uniformly bounded as 
operators in B ,Bi, B 2 , with the norms not exceeding e Ks with a constant K (the same 
for all Bj and L t ), 

(iv) L t f , as a function t \- > B 2 , depends continuously on t locally uniformly in f (i.e. 
for f from bounded subsets of B\). 
Then 

(i) the T-product Texp{ J Q S L T dr}f exists for all f E B 2 , and the convergence in ( TT9|) 
is uniform in f on any bounded subset of B\; 

(ii) if f G B , then the approximations U A (s,r) converge also in B x ; 

(Hi) this T-product defines a strongly continuous (int,s) family of uniformly bounded 
operators in both B\ and B 2 , 

(iv) this T-product Texp{ J Q S L T dr}f is a solution of problem (120]) for any f e B\. 

Proof, (i) Since Bi is dense in B 2 and all U A (s,r) are uniformly bounded in B 2 (by (iii)), 
the existence of the T-product for all / 6 B 2 follows from its existence for f E B 1 . In the 
latter case it follows from the formula 

U A (s,r) - U A ,(s,r) = U A/ (s,T)U A (r,r)\ T T =° = J* ^-U A/ {s,r)U A {r,r) dr 
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/ U a >(s,t)(L [t]a - L [T]AI )U A (r,r)dT 

J r 



(where we denoted [s] A = tj for tj < s < tj+i), because L t are uniformly continuous 
(condition (iv)) and U A (s,r) are uniformly bounded in B 2 and B x (by condition (iii)). 
(ii) If / G B , then the equations 



U A (s,r) = L [T]A U A (T,r)dr, 

J r 



imply that the family U A (s,t) is uniformly Lipschitz continuous in Bi as a function of t, 
because L s are uniformly bounded operators B — > B\ and U A (s, r) are uniformly bounded 
in B Q . Hence one can choose a subsequence, U An (s,r), converging in C([0, T],Bi). But 
the limit is unique (it is the limit in B 2 ), implying the convergence of the whole family 
U A (s,t), as 5(A) 0. 

(iii) It follows from (iii) that the limiting propagator is bounded. Strong continuity in 
B\ is deduced first for /gBo and then for all / G B\ by the density argument. 

(iv) If / G Bo, we can pass to the limit in the above approximate equations to obtain 
the equation 

U(s,r)f= f L T U(r,r)fdr. 



Since B is dense in Bi, we then deduce the same equation for an arbitrary / G Bi. This 
implies that U(s,r)f satisfies equation f[2"Uj) by condition (iv) and the basic theorem of 
calculus. □ 

To conclude the section we present a rather general example of a non-homogeneous 
generator of a strongly continuous Markov propagator specifying a time nonhomogeneous 
Feller process. This will be a time-nonhomogeneous possibly degenerate diffusion com- 
bined with a mixture of possibly degenerate stable-like processes and processes generated 
by the operators of order at most one, that is a process generated by an operator of the 
form 

L t f(x) = Uv(a t (x)aJ(x)V 2 f(x)) + (b t (x), V/(x)) + J (f(x + y) - f{x))v t {x, dy) 

+ / (dp) / d\y\ / a Ptt (x,s) u p>t (ds). (21) 

j p Jo j s d 1 i y i 

Here s = y/\y\, K > and (P, dp) is a Borel space with a finite measure dp and co P}t are 
certain finite Borel measures on S^ 1 . 

Proposition 4.1. Let the functions o~,b,a,a and the finite measure \y\u(x,dy) be of 
smoothness class C 5 with respect to all variables (the measure is smooth in the weak 
sense), and a p ,a p take values in compact subintervals of (0, oo) and (0,2) respectively. 
Then the family of operators L t of form ( 12T|) generates a backward propagator U t)S on the 
invariant domain £7^(11^), and hence a unique Markov process. 

Proof. For a detailed proof (that uses several ingredients including Theorem 14. II as a final 
step) we refer to the book [11]. □ 
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5 Nonlinear propagators 

The following result from [10] represents the basic tool allowing one to build nonlinear 
propagators from infinitesimal linear ones. 

Recall that V s,t denotes the dual of U t,s given by Theorem 12.11 Let M be a bounded 
subset of B* that is closed in the norm topologies of both B* and D*. For a fi G M 
let C M ([0,r],M) be the metric space of the continuous in the norm D* curves £ s G M, 
s E [0, r], £o = Ai, with the distance 

p(t,V.) = SU P 116 -Vs\\d*- 

se[0,r] 

Theorem 5.1. (i) Let D be a dense subspace of a Banach space B that is itself a Banach 
space such that H/Hd > ||/||b> an d let £ (-)■ A[£\ be a mapping from B* to bounded linear 
operators A[£] : D — >■ B such that 

||A[e]-A[77]|| D _ fl < C ||e-77|b*, ^e5*. (22) 

(ii) For any fx E M and £. G C M ([0, r], M), let the operator curve A[£ t ] : D — > B 
generate a strongly continuous backward propagator of uniformly bounded linear operators 
inB,0<t<s<r, on the common invariant domain D (in particular, ([6]) 
holds), such that 

||£/*' s [£] \\d^d <c, t<s<r, (23) 

for some constant c > and with their dual propagators V s,t [^] preserving the set M. 
Then the weak nonlinear Cauchy problem 

— (f, fi t ) = (A[fx t ]f, fi t ), fx = fx, f ED, (24) 

is well posed in M. More precisely, for any fi E M it has a unique solution T t (fx) E M , 
and the transformations T t of M form a semigroup for t E [0, r] depending Lipschitz 
continuously on time t and the initial data in the norm of D*, i.e. 

\\T t {fi)-T t {ri)\\ D * <c(r,M) \\/x- rj\\ D *, \\T t (/x) - fi\\ D * < c(r, M)t (25) 

with a constant c(r, M) . 

Proof. Since 

and 

u ^} - u ^} = u^iep^ 2 } \i =0 

= fu^[£KA[tl]-A[&)u*[ttd8, 

Jo 

and taking into account (j22j) and (j23D one deduces that 

<tc{r,M) sup Ul-C 2 s \\n* 

se[0,r] 
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(of course we used the assumed boundedness of M), implying that for t < to with a 
small enough to the mapping £ t \-t V t '°[^,] is a contraction in C M ([0, t], M). Hence by the 
contraction principle there exists a unique fixed point for this mapping. To obtain the 
unique global solution one just has to iterate the construction on the next interval [to, 2t ], 
then on [2t , 3t ], etc. The semigroup property of T t follows directly from uniqueness. 
Finally, if T t (/i) = fi t and T t (r]) = r\ t , then 

IH-Vt = V-VlA* - V^lvlv = (^'Vl - V^[r,])fA + V^h]{/A - v)- 
Estimating the first term as above yields 

sup ||/i s - r] s \\ D * < c(r,M)(tswp \\/I s - T) S \\ D * + - T]\\ D *), 

s<t s<t 

which implies the first estimate in ( 125]) first for small times, which is then extended to all 
finite times by the iteration. The second estimate in (|25|) follows from ([8]). □ 

Remark 3. For our purposes, the basic examples are given by B = Coo(R d ), M = V(R d ), 
and D = C^ (R d ) or D = C^ Q (R ). In order to see that V(R. d ) is closed in the norm 
topology of D* for D = (^(R^) with any natural k, observe that the distance d on V(Tl d ) 
induced by its embedding in (C^TV 1 ))' is defined by 

dfav) = 8up{|(/,/x - V )\:fe Cl(R d ), \\f\\c U ^) < !}• 

and hence 

dM = sup{|(/,/x-77)| : / E C 2 (R d ), ||/|| c2 ( Rd) < 1}. 

Consequently, convergence ji n — > \i, \i n G V(R d ), with respect to this metric implies the 
convergence (f, //„) — > (f, /i) for all f G C fc (R d ) and hence for all f G Coo(R d ) and for f 
being constants. This implies tightness of the family fi n and that the limit fi G ^(R^). 

Theorem 14. II supplies a useful criterion for condition (ii) of the previous theorem, thus 
yielding the following corollary. 

Theorem 5.2. Under the assumption (i) of Theorem \5.1\ assume instead of (ii) the fol- 
lowing: 

(ii 7 ) There exists another Banach space D, which is a dense subspace of D, so that all 
A[fi], fi G M, are uniformly bounded operators D — >■ D and D — > B . 

(Hi 7 ) For any fi G M the operator A[p] : D — > B generates a strongly continuous 
semigroup e tA ^ in B with invariant core D, such that D is also invariant under all e sA ^\ 
and these operators are uniformly bounded as operators in D,D, B, with the norms not 
exceeding e Ks with a constant K, 

(iv 7 ) the set M is invariant under all dual semigroups (e tA ^)' . 

Then condition (ii) and hence the conclusion of Theorem 15.11 hold. Moreover, the 
operators U t,s [fi] form a strongly continuous propagator of bounded operators in D. 

Proof. For £. G C^QO, r], M), the operator curve L s = A[£ s ] : D — >■ B clearly satisfies 
conditions (i)-(iii) of Theorem 14.11 To check its last condition (iv) we have to show that 
A[£t]/ as a function t i — ?• i? is continuous uniformly for / from a bounded domain of D. 
And this follows from (1221) . as it implies 

\\(A[^ t ]-A[^])f\\ B <cU t -a D 4f\\ D . 

Hence Theorem 14.11 is applicable to the curve L s = A[£ s ] : D — >■ B, implying condition 
(ii) of Theorem 15.11 □ 
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As a preliminary step in studying sensitivity, let us prove a simple stability result 
for the above nonlinear semigroups T t with respect to the small perturbations of the 
generator. 

Theorem 5.3. Under the assumptions of Theorem I5.il suppose £ y A[£] is another 
mapping from B* to bounded operators D — > B satisfying the same condition as A with 
the corresponding U t,s , V S)t satisfying the same conditions as U t,s , V s,t . Suppose 

\\A[Z]-A[£\\\ D -+ b <k, £GM (26) 

with a constant k. Then 

\\f t (rj) - T t (fi) \\ D * < c(r, M)(k + \\» - V \\ D *). (27) 
Proof. As in the proof of Theorem 15.11 denoting T t (fi) = fit and T t {j]) = fj t one can write 

and then 

sup \\ii s - f) s \\ D * < c(r, M) I t(sup \\iJ, s - fj s \\ D * + k) + - r)\\ D * 

8<t V S<t 

which implies ( 1271) first for small times, and then for all finite times by iterations. □ 



6 Linearized evolution around a path of a nonlinear 
semigroup 

Both for numerical simulations and for the application to interacting particles, it is cru- 
cial to analyze the dependence of the solutions to nonlinear kinetic equations on some 
parameters and on the initial data. Ideally we would like to have smooth dependence. 

More precisely, suppose we are given a family of operators A Q [/i], depending on a real 
parameter a and satisfying the assumptions of Theorem 15. II for each a. For /x" = //"(/Xq), 
a solution to corresponding (JT|) with the initial condition /Xq, we are interested in the 
derivative 

6(«) - 9 £- (28) 

In this section we shall start with the analysis of the linearized evolution around a path 
of a nonlinear semigroup. Namely, differentiating (JI]) (at least formally for the moment) 
with respect to a yields the equation 

= (A"\/j«\9M<*)) + (Ds t{a) A°<[tf}g,tf) + (^^W) , (29) 
with the initial condition 

e ° = = If' (30) 

where 

D v A a [ri = lim -(A a [fx + s V ] - A a [fi}) (31) 

s->0+ s 
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denotes the Gateaux derivatives of A[/j] as a mapping D* — > C(D, B), assuming that the 
definition of ^4 Q [/i] can be extended to a neighborhood of M in D*. 

This section is devoted to the preliminary analysis of the solutions to equation (1291) . 
In the next section we shall explore their connections with the derivatives from the r.h.s. 
of (J2ED. 

Let D C D C B be, as above, three Banach spaces such that || > || \\d > || ||b, D 
is dense in B in the topology of B and D is dense in D in the topology of B; and let M 
and Cfj,([Q,r], M) be defined as in Section [5j 

Theorem 6.1. (i) Let, for each a, £ i— > A a [C,] be a mapping from B* to linear operators 
A a [£] that are uniformly bounded as operators D — > B and D — >• D and such that 

\\A[i}-A[ V \\\ D ^ B <cU--n\\ jy ., {;,r)eB* (32) 

for a constant c > 0. 

(ii) For any a, fi G M and £, G C M ([0, r], M) ; Zei t/ie operator curve A a [^ t } generate a 
strongly continuous backward propagator of uniformly bounded linear operators U t,s ' ,a [^], 
0<t<s<r,inBon the common invariant domain D, and with the dual propagator 
V s,t ' a [^] preserving the set M. 

(Hi) Let the propagators t < s, are strongly continuous and bounded prop- 

agators in both B and D. 

(iv) Let the derivatives dA a \pf] /da exist in the norm topologies of C(D,B) and 
C(D,D), and represent also bounded operators in C(D,B) and C(D,D). 

(v) Let A a [[i\ can be extended to a mapping D* — > C(D, B) such that the limit in (115]) 
exists in the norm topology of C(D,B) for any \i G B*, £ G D*. Moreover, the Gateaux 
derivatives £ t— > D^A a \p] is continuous in \i (taken in the norm topology of B*) and defines 
a bounded linear operator D* — > C(D, B), that is 

\\DtA a in]\\ D ^ B < cMb+UWd* (33) 

with a constant c. 

(vi) Finally, suppose there exists a representation 

(D ( A"Mg,iJ.) = (F a \Ag,t) (34) 

with F a [/j] being a continuous mapping D* — >■ C(D,D). 

Then, for each a, fi G M, there exists a weakly-* continuous in D* family of propagator 
U s,t [a,fj] (constructed below) solving equation (|29|) in D*, that is, for any £q G D*, ^ = 
n s,i [a,/i]^o satisfies (|29|) for any f G D. 

Remark 4. Condition (vi) causes no trouble. In fact it follows from duality and addi- 
tional weak continuity assumption on D^. We shall not formulate this assumption by two 
reasons, (i) In case of reflexive B it is satisfied automatically, (ii) Though in case we are 
most interested in, that is for B* being the space of Borel measures, B is not reflexive, in 
applications to Markov semigroup representation (I34p again arises automatically, due to 
the special structure of A[fi] (of the Levy-Khintchin type). 

Remark 5. Construction of propagators from condition (ii) can naturally be carried out 
via Theorem 15-4 that is via T -products. 
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Proof. Theorem 15.11 implies that, for any a, the weak nonlinear Cauchy problem 

^{f,ti) = {A°\tf\f,fi), Mo = M, /GA (35) 

is well posed in M, and its resolving semigroup T t a satisfies (1251) uniformly in a. 
Next, the equation 

j t (9,U<x)) = (.A°\jj*\g, &(<*)) + (Ds t(a) A<*[tf]g,tf) (36) 
has form ffTTl) with F, specified by (jMD , i.e. 

(F s g,0 = (F a [^]g,0 = (D^A a ^]g 7 tf). 
From (1331) it follows that 

\\F S \\ D ^ D = sup sup {DsA a [tf)g,^)<cU\\ D 4(x\\ 2 B *, (37) 

IMId<i II5IId*<i 

which is uniformly bounded for ^ e M. Consequently, Theorem 13 . 21 yields a construction 
of the strongly continuous family {$*' r } in D such that its dual propagator {\l/ r '* = ($* ,r )'} 
solves the Cauchy problem for equation (|36|) . 

By the Duhamel principle, the solution to equation (129]) for r > t with the initial 
condition £ 4 can be written as 

( — ^^• r [a l ^,A*?J ds- (38) 

□ 

Theorem 6.2. Under the assumptions of Theorem \6.1\ assume additionally that the back- 
ward propagators , t < s, represent strongly continuous bounded propagators 
also in D ( and hence, by the last statement of Theorem \2.3L the family A a [£ t ] : D — >■ B 
also generates {U t,s,a }, as a propagator in D, on D). Then, for each G M, £ £ 
t/ie curve U s,t [a, fi]C,Q represents the unique weakly-* continuous in D* solution to equation 
([29]) in D*. 

Proof. This is a straightforward extension of Theorem l6.ll obtained by taking into account 
the simple arguments given before Theorem 13.21 □ 

We shall not further pay attention to somewhat complicated details arising under the 
conditions of Theorem 16.11 but will use more natural conditions of Theorem 16.21 
We complete this section by an additional stability result for II s '*. 

Theorem 6.3. Under the assumptions of Theorem \6.2. suppose that 

(i) in addition to fl32|) and fl33l . one has the same properties for the pair (D,D), i.e. 

\M$-AM\\6^D<4t-v\\D', (39) 

IP^ a M!b^<c||//||^||e!l^, (40) 
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(ii) derivatives of A a [fj] are Lipschitz in the norm-topology of D* , more precisely: 

u dA a [fi] dA a [r]] ^ .. 

\\D^A a [^] -A a [u])\\D^ B < c\\ti-v\Mm^. (42) 

Suppose now that /Xo(n) — > /Xq m the norm-topology of D* , as n — )■ oo /or eac/x a. 
T/xen n s,i [a, (n)]^o - >■ n s '*[a, /Xq (?x)]£o weakly-* in D* and in the norm topology of D*. 

Proof. We shall use the notation for propagators introduced above adding dependence on 
n for all objects constructed from /Xg(n). 

By (125|) we conclude that Tf/x^n) — > T/*/Xg, as n — )■ oo, in the norm-topology of D* 
uniformly in t, a. Hence, by and Theorem 12.41 (applied to the pair of spaces (D, D)), 

[/*' s;Q [r a /x°(n)] -> Z7*'* ;a [r a ^] 

in the norm-topology of C(D,D). Similarly, by (HUj) and (jUJ, 

< |p e (^ a N - A«[r,])g,ii)\ + K^W^/x-ry)! 

< c||/x - r7lb*||#|lsll£lb*(IHlB* + \\v\\b*), 

so that 

\\F s [/i]g - F s [r]]g\\ D < c||/x - r/iMMbGHU* + II^IU*)- 
and thus by Theorem 12. 4[ 

¥' s [a,T a ^(n)\ ->■ $*' s [a,T>^], n -> oo, 

in the norm-topology of C(D,D). Consequently, again by Theorem 12. 4 [ 

^[a,TX(n)]e^* s ' t [a,T>o]e 

weakly-* in D* and in the norm-topology of D*, for any £ G D*. 
Finally, from (138|) it follows that 

(s,n^V/x](n)£-n'>,/x]£) 

= ((d>°» - S^fl + f ( Ma ^f (n)1 (^' r (n) - $ s %x) 



da s s J ./n V V da da 

which allows one to conclude that 

Hn^^/xK^e-n^^/xjeil^^o, 

as n — > oo, as required. □ 
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7 Sensitivity analysis for nonlinear propagators 



Our final question is whether the solution £ t constructed in Theorem 16. II does in fact yield 
the derivative f l28|) . The difference with the standard case, discussed in textbooks on ODE 
in Banach spaces, lies in the fact that the solution to the linearized equation ( 1291) exists 
in a different space that the nonlinear curve /i t itself. 

Theorem 7.1. Under the assumptions of Theorem \6.3[ let £o = £ e B* and is defined by 
f l30|) . where the derivative exists in the norm-topology of D* and weakly-* in D* . Then 
the unique solution £t[oi] = II*' [a, /Uq]£ °f equation fl29|) constructed in the Theorem \ 6.2\ 
satisfies ( 128]) . where the derivative exists in the norm-topology of D* and weakly-* in D*. 

Proof. The main idea is to approximate A" by bounded operators, use the standard 
sensitivity theory for vector valued ODE and then obtain the required result by passing 
to the limit. To carry our this program, let us pick up a family of operators A°(n), 
n = 1,2, bounded in B and D, that satisfy all the same conditions as A® and such 
that ||(A°(n) — — > for all g G D and uniformly for all a and g from bounded 
subsets of D. As such approximation, one can use either standard Iosida approximation 
(which is convenient in abstract setting) or, in case of the generators of Feller Markov 
processes, generators of approximating pure-jump Markov processes. As in the proof of 
Theorem 16. 3[ we shall use the notation for propagators introduced in the previous section 
adding dependence on n for all objects constructed from A™(n). 

Since (Af(n))' are bounded linear operators in B* and D*, the equation for \i t and £ t 
are both well posed in the strong sense in both B* and D*. Hence the standard result on 
the differentiation with respect to initial data is applicable (see e.g. [13J or Appendix D 
in [HI]) leading to the conclusion that £t[a]( n ) represent the derivatives of /4*(n) in both 
B* and D*. 

Consequently 

^(n)-/C(n)= [m{n)dp (43) 

holds as an equation in D* (and in B* whenever £ e B*). 

Using Theorem 15.31 we deduce the convergence of /J>f(n) to in the norm-topology 
of D*. Consequently, using Theorem 16.31 we can deduce the convergence of £°{ri) to £™ in 
the norm-topology of D*. Hence, we can pass to the limit n — > oo in equation (|43|) in the 
norm topology of D* yielding the equation 

tf-»?= ["mw, ( 44 ) 

where all objects are well defined in (Cl CJ (R, d ))* . 

This equation together with continuous dependence of £4 on a (which is proved in 
literally the same way as continuous dependence on \x in Theorem 16. 3j) implies ( 128|) in the 
sense required. □ 

Applying Theorem 17.11 for the case of A s not depending on any additional parameter, 
we obtain directly the smooth dependence of the nonlinear evolution fi t on the initial 
data. Namely, for fi t = /^(/x ), a solution to ([T]) with the initial condition fi , we can 
define the Gateaux derivatives 

&G"o,0 = Dtntipo) = lim -QitQio + s£) - ih(jm>)) (45) 

s->0+ s 
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Differentiating (JTJ) with respect to initial data yields 



d 
dl 



(46) 



which represents a simple particular case of equation fl29|) . Hence, Theorem 17.11 implies 
that, under the assumptions of this theorem (that do not involve the dependence on a), 
the derivative (j4"51) does exists and is given by the unique solution to equation ( l4"6"j) with 
the initial condition £ = £, However, this existence and well-posedness hold weakly-* in 
D*, not in B*, as the nonlinear evolution itself. 

8 Back to nonlinear Markov semigroups 

We developed the theory in the most abstract form, for general nonlinear evolutions in 
Banach spaces, not even using positivity. This unified exposition allows one to obtain 
various concrete evolutions as a direct consequence of one general result. The main 
application we have in mind concerns the families A\p] of the Levy-Kchintchin type form 
(with variable coefficients): 



given in the introduction. 

Applied to nonlinear Levy process specified by the families PJ, our general results 
yield the following. 

Theorem 8.1. Suppose the coefficients of a family (H} depend on fj, Lipschitz continuously 
in the norm of the Banach space (C^TV 1 ))' dual to C^(R ), i.e. 



with constant k. Then there exists a unique nonlinear Levy semigroup generated by A^, 
and hence a unique nonlinear Levy process. 

Proof. The well-posedness of all intermediate propagators is obvious in case of Levy pro- 
cesses, because they are constructed via Fourier transform, literally like Levy semigroup 



(details are given in pTOJ). Of course here M = T(R d ), D = C^(R d ), D = C^(R d ). □ 



Remark 6. Condition (f48|) is not at all weird. It is satisfied, for instance, when the 
coefficients G,b, v depend on \i via certain integrals (possibly multiple) with smooth enough 
densities, i.e. in a way that is usually met in applications. 

Applied to processes of order at most one specified by the families (jSJ), our general 
results yield the following. 




\\G(v) - G( V )\\ + ||6(/i) - 6(i,) || + / min(l, \y\ 2 )Hfi, dy) - u( V ,dy) 



s K||//-»7ii(ca ) (R«»))' 



k sup \(f,H-v)\ 



(48) 
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Theorem 8.2. Assume that for any \x G V(R d ), &(.,//) G C 1 (R d ) and Vv(x, /j,,dy) 
(gradient with respect to x) exists in the weak sense as a signed measure and depends 
weakly continuous on x. Let the following conditions hold. 

(i) boundedness: 

sup / min(l, \y\)u(x, /i, dy) < oo, sup / min(l, |y|)|Vz/(a;, /x, dy)\ < oo, (49) 

(ii) tightness: for any e > there exists a K > stzc/i tTiat 1 



sup / u(x, fi,dy) < e, sup / |Vz/(x, /i, <i?/)| < e, (50) 

JR d \B K Jn d \B K 



sup / /j, dy) < e, (51) 

(Hi) Lipschitz continuity: 

sup / min(l, \y\)\v(x,/n,dy) - v{x, [i 2 ,dy)\ < c||/i X — A*a|l (c^cn**))*, ( 52 ) 



sup|6(z,//i) - fc(z,/j 2 )| < c||//i-// 2 ||(ca b (R'»))* ( 53 ) 

uniformly for bounded /ii, //2- 

JTien t/ie u>ea£; nonlinear Cauchy problem ([Q) wift given fry ([5]) we// posed, i.e. 
for any jj, G ^(R^) it has a unique solution T t {jj) G Ai{H d ) (so that ([5]) holds for all 
g G ClciTV*)) preserving the norm, and the transformations T t ofV(R d ), t > 0, form a 
semigroup depending Lipschitz continuously on time t and the initial data in the norm of 

(ci(R d )y. 

Proof. Here we use M = V(R d ), D = C^(R d ), D = C^(R d ). The corresponding 
auxiliary propagators required in Theorem 12.11 are constructed in [TU] (Chapter 4) and 
PH (Chapter 5). □ 

In both cases above, straightforward additional smoothness assumptions on the coef- 
ficients of the generator yield smoothness with respect to parameters and/or initial data 
via Theorem 17.11 

Similarly one gets the well-posedness for mixtures of nonlinear diffusions and stable- 
like processes given by f )2T|) with coefficients depending on distribution /i. Our theory 
also applies to nonlinear stable-like processes on manifolds, see pH] (Section 11.4), and to 
nonlinear dynamic quantum semigroups, see [10] (Section 11.3). 

Let us stress again, referring to \±0\, [7] and [6], that the first and second derivatives 
of nonlinear Markov semigroups with respect to initial data (for simplicity, we dealt only 
with the first derivative here) describe the dynamic law of large numbers for interacting 
particle systems and the corresponding central limit theorem for fluctuations, respectively. 
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